An Avatar-Led Web-Based and SMS Text Message Smoking Cessation Program for Socioeconomically Disadvantaged Veterans: Pilot Randomized Controlled Trial

Background Despite the declining prevalence of cigarette smoking in the United States, socioeconomically disadvantaged veterans receiving care from the Veterans Health Administration have a high prevalence of smoking. Currently, available treatment options for these veterans focus on tobacco users who are ready to quit and have limited reach. Consequently, there is a great need for accessible, effective smoking cessation interventions for veterans at all levels of readiness to quit smoking. Objective To address these needs, we developed Vet Flexiquit, a web-based Acceptance and Commitment Therapy program for veterans, and evaluated its acceptability (primary aim), efficacy, and impact on theory-based change processes relative to the National Cancer Institute’s SmokefreeVET program in a pilot randomized controlled trial. Methods Participants (N=49) were randomized 1:1 to receive either the Vet Flexiquit (n=25) or SmokefreeVET (n=24) web program. Both groups received SMS text messages as part of the intervention for 6 weeks. Both interventions are fully automated and self-guided. Primary outcome data were collected at 3 months after the randomization. Self-reported smoking abstinence was biochemically verified using saliva cotinine. Multivariable logistic regression, negative binomial regression, and linear regression models were used to evaluate the association between the treatment arm and outcomes of interest. Results Acceptability, as measured by overall treatment satisfaction, was high and similar across treatment arms: 100% (17/17) for Vet Flexiquit and 95% (18/19) for SmokefreeVET. Acceptability, as measured by utilization, was more modest (log-ins: M=3.7 for Vet Flexiquit and M=3.2 for SmokefreeVET). There were no statistically significant differences between treatment arms for any acceptability measures. Similarly, there were no statistically significant differences between treatment arms in the secondary outcomes of smoking cessation or change in Acceptance and Commitment Therapy’s theory-based processes. In open-ended survey responses, some veterans in both treatment arms expressed interest in having support from a professional or peer to enhance their experience, as well as an expanded SMS text messaging program. Conclusions Both programs had high ratings of acceptability, limited utilization, and a similar impact on cessation and cessation processes. Taken together with the qualitative data suggesting that additional support may enhance participants’ experience of both programs, these preliminary findings suggest that the programs may have similar outcomes among veterans who are looking for a digital cessation treatment option and that integrating provider or peer support and enhancing the SMS text messaging program holds promise as a means of boosting engagement and outcomes for both programs. Trial Registration ClinicalTrials.gov NCT04502524; https://clinicaltrials.gov/ct2/show/NCT04502524

Is this a full powered effectiveness trial or a pilot/feasibility trial? * Manuscript tracking number * If this is a JMIR submission, please provide the manuscript tracking number under "other" (The ms tracking number can be found in the submission acknowledgement email, or when you login as author in JMIR. If the paper is already published in JMIR, then the ms tracking number is the four-digit number at the end of the DOI, to be found at the bottom of each published article in JMIR)

1a-i) Identify the mode of delivery in the title
Identify the mode of delivery. Preferably use "web-based" and/or "mobile" and/or "electronic game" in the title. Avoid ambiguous terms like "online", "virtual", "interactive". Use "Internet-based" only if Intervention includes non-web-based Internet components (e.g. email), use "computer-based" or "electronic" only if o ine products are used. Use "virtual" only in the context of "virtual reality" (3-D worlds). Use "online" only in the context of "online support groups". Complement or substitute product names with broader terms for the class of products (such as "mobile" or "smart phone" instead of "iphone"), especially if the application runs on different platforms. Does your paper address subitem 1a-i? * Copy and paste relevant sections from manuscript title (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study

1a-ii) Non-web-based components or important co-interventions in title
Mention non-web-based components or important co-interventions in title, if any (e.g., "with telephone support").
C l e a r s e l e c t i o n Does your paper address subitem 1a-ii?
Copy and paste relevant sections from manuscript title (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study  Does your paper address subitem 1b-i? * Copy and paste relevant sections from the manuscript abstract (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study "To address these needs, we developed Vet Flexiquit, a web-based Acceptance and Commitment Therapy (ACT) program for veterans, and evaluated its acceptability (primary aim), efficacy, and impact on theory-based change processes relative to the National Cancer Institute's SmokefreeVET program in a pilot randomized controlled trial." 1b-ii) Level of human involvement in the METHODS section of the ABSTRACT Clarify the level of human involvement in the abstract, e.g., use phrases like "fully automated" vs. "therapist/nurse/care provider/physician-assisted" (mention number and expertise of providers involved, if any). (Note: Only report in the abstract what the main paper is reporting. If this information is missing from the main body of text, consider adding it) C l e a r s e l e c t i o n Does your paper address subitem 1b-ii?
Copy and paste relevant sections from the manuscript abstract (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study "Both Interventions are fully automated and self-guided." Copy and paste relevant sections from the manuscript abstract (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study "With the exception of some recruitment activities, the conduct of the trial was conducted in a fully remote setting-a modification to the original study procedures necessitated by the COVID-19 pandemic." Copy and paste relevant sections from the manuscript abstract (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study "Both programs had high ratings of acceptability, limited utilization, and a similar impact on cessation and cessation processes. Taken together with the qualitative data suggesting that additional support may enhance participants' experience of both programs, these preliminary findings suggest that the programs may have similar outcomes among vVeterans who are looking for a digital cessation treatment option and that integrating provider or peer support and enhancing the SMS text messaging program holds promise as a means of boosting engagement and outcomes for both programs." 93% of the participants were satisfied overall, 100% reported that the program was easy to navigate, and 100% said that they felt clearer about how they might quit because of using the EQQUAL program. On the acceptability outcome of program usage, the average number of log-ins was 5.5 (SD= 3.6), the average number of sessions completed was 3.1 (SD= 2.6), and 39% completed all 6 sessions. Biochemically-confirmed 7-day point prevalence abstinence at the end of treatment was 22.7%, which is 3 times higher than the only other targeted digital smoking cessation intervention for sexual and gender minority young adults [42]." METHODS 3a) Description of trial design (such as parallel, factorial) including allocation ratio 3b) Important changes to methods after trial commencement (such as eligibility criteria), with reasons Does your paper address CONSORT subitem 2b? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study "The primary aim of this study was to compare the relative acceptability of Vet Flexiquit versus SmokefreeVET among socioeconomically disadvantaged U.S. veterans, as indicated by treatment satisfaction and objective measures of web site use. The secondary aim was to preliminarily evaluate the effects of Vet Flexiquit versus SmokefreeVET on quit attempts and abstinence rates as well as readiness to quit and acceptance of smoking triggers-ACT's theory-based mechanism of change." Does your paper address CONSORT subitem 3a? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study "Eligible participants were randomized using an automated algorithm via a custom webbased system at the baseline visit, which occurred approximately 1 week after screening and was conducted via telephone or a VA-approved conferencing program. A permuted block design with random blocks of sizes 2 and 4 was used to balance randomization on the stratification variable: high (>5) or low (≤5 or less) readiness to quit on the Contemplation Ladder [39]." Does your paper address CONSORT subitem 3b? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study "With the exception of some recruitment activities, the conduct of the trial was conducted in a fully remote setting-a modification to the original study procedures necessitated by the COVID-19 pandemic."

3b-i) Bug fixes, Downtimes, Content Changes
Bug xes, Downtimes, Content Changes: ehealth systems are often dynamic systems. A description of changes to methods therefore also includes important changes made on the intervention or comparator during the trial (e.g., major bug xes or changes in the functionality or content) (5-iii) and other "unexpected events" that may have in uenced study design such as staff changes, system failures/downtimes, etc. Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study Nothing to report under this item Does your paper address CONSORT subitem 4a? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study Inclusion criteria were as follows: (1) U.S. veteran;, (2) age ≥18 years, (3) meets the VHA national threshold for no-cost health care based on income or disability status;, (4) current smoker, averaging at least 5 cigarettes per /day for the last 30 days;, (5) weekly Internet access for the next 3 months; (6) current use of a personal email address to receive the link to their assigned web site; and (7) willingness to complete all study activities and to receive study-related SMS text messages. Exclusion criteria were as follows: (1) currently taking part in any other smoking cessation treatment including pharmacotherapies, counseling, or other digital cessation programs;, (2) recent (past 30 days) substance use disorder, suicidal ideation, or psychiatric hospitalization, (3)

4a-i) Computer / Internet literacy
Computer / Internet literacy is often an implicit "de facto" eligibility criterion -this should be explicitly clari ed.
C l e a r s e l e c t i o n Does your paper address subitem 4a-i?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study There were no explicit eligibility criteria around computer/Internet literacy, although participants were required to have email subitem not at all important 1 2 3 4 5 essential 4a-ii) Open vs. closed, web-based vs. face-to-face assessments: Open vs. closed, web-based vs. face-to-face assessments: Mention how participants were recruited (online vs. o ine), e.g., from an open access website or from a clinic, and clarify if this was a purely web-based trial, or there were face-to-face components (as part of the intervention or for assessment), i.e., to what degree got the study team to know the participant. In online-only trials, clarify if participants were quasi-anonymous and whether having multiple identities was possible or whether technical or logistical measures (e.g., cookies, email con rmation, phone calls) were used to detect/prevent these.
C l e a r s e l e c t i o n Does your paper address subitem 4a-ii? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study "Participants were recruited from the VA Bedford Healthcare System, as well as via flyers and outreach to VA providers in the Boston metro area." Study assessments were completed via telephone or videoconferencing software. subitem not at all important 1 2 3 4 5 essential 4b) Settings and locations where the data were collected 4a-iii) Information giving during recruitment Information given during recruitment. Specify how participants were briefed for recruitment and in the informed consent procedures (e.g., publish the informed consent documentation as appendix, see also item X26), as this information may have an effect on user self-selection, user expectation and may also bias results.
C l e a r s e l e c t i o n Does your paper address subitem 4a-iii?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study This is not included in the paper Does your paper address CONSORT subitem 4b? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study "All assessments were administered via telephone or VA-approved conferencing programs by trained study staff." 4b-i) Report if outcomes were (self-)assessed through online questionnaires Clearly report if outcomes were (self-)assessed through online questionnaires (as common in web-based trials) or otherwise.
C l e a r s e l e c t i o n Does your paper address subitem 4b-i? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study "All assessments were administered via telephone or VA-approved conferencing programs by trained study staff. " Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study Your answer subitem not at all important 1 2 3 4 5 essential 5-ii) Describe the history/development process Describe the history/development process of the application and previous formative evaluations (e.g., focus groups, usability testing), as these will have an impact on adoption/use rates and help with interpreting results.
C l e a r s e l e c t i o n Does your paper address subitem 5-ii?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study "We followed a user-centered design process to develop a veteran-tailored version of the Flexiquit program, called Vet Flexiquit, to enhance current smoking cessation treatment offerings within the VHA." The user-centered design work will be presented in a different paper.

5-iii) Revisions and updating
Revisions and updating. Clearly mention the date and/or version number of the application/intervention (and comparator, if applicable) evaluated, or describe whether the intervention underwent major changes during the evaluation process, or whether the development and/or content was "frozen" during the trial. Describe dynamic components such as news feeds or changing content which may have an impact on the replicability of the intervention (for unexpected events see item 3b).
C l e a r s e l e c t i o n Does your paper address subitem 5-iii?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study This information is not included in paper, but the interventions were both "frozen" during the trial and there was no dynamic content. Does your paper address subitem 5-iv?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study Quality assurance for content is review by experts who are part of the research team. subitem not at all important 1 2 3 4 5 essential 5-v) Ensure replicability by publishing the source code, and/or providing screenshots/screen-capture video, and/or providing flowcharts of the algorithms used Ensure replicability by publishing the source code, and/or providing screenshots/screencapture video, and/or providing owcharts of the algorithms used. Replicability (i.e., other researchers should in principle be able to replicate the study) is a hallmark of scienti c reporting.
C l e a r s e l e c t i o n Does your paper address subitem 5-v?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study The appendix includes a screenshot of the program.

5-vi) Digital preservation
Digital preservation: Provide the URL of the application, but as the intervention is likely to change or disappear over the course of the years; also make sure the intervention is archived (Internet Archive, webcitation.org, and/or publishing the source code or screenshots/videos alongside the article). As pages behind login screens cannot be archived, consider creating demo pages which are accessible without login.
C l e a r s e l e c t i o n Does your paper address subitem 5-vi?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study The program is not currently available for review

5-vii) Access
Access: Describe how participants accessed the application, in what setting/context, if they had to pay (or were paid) or not, whether they had to be a member of speci c group. If known, describe how participants obtained "access to the platform and Internet" [1]. To ensure access for editors/reviewers/readers, consider to provide a "backdoor" login account or demo mode for reviewers/readers to explore the application (also important for archiving purposes, see vi).
C l e a r s e l e c t i o n Does your paper address subitem 5-vii? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study Participants were able to access the programs at their convenience. No payment was required to participate.

5-ix) Describe use parameters
Describe use parameters (e.g., intended "doses" and optimal timing for use). Clarify what instructions or recommendations were given to the user, e.g., regarding timing, frequency, heaviness of use, if any, or was the intervention used ad libitum.
C l e a r s e l e c t i o n Does your paper address subitem 5-ix?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study Usage of both programs is ad lib, although Vet Flexquit content has a locking feature to ensure a minimum of 3 days elapsed between sessions.

5-x) Clarify the level of human involvement
Clarify the level of human involvement (care providers or health professionals, also technical assistance) in the e-intervention or as co-intervention (detail number and expertise of professionals involved, if any, as well as "type of assistance offered, the timing and frequency of the support, how it is initiated, and the medium by which the assistance is delivered". It may be necessary to distinguish between the level of human involvement required for the trial, and the level of human involvement required for a routine application outside of a RCT setting (discuss under item 21 -generalizability).
C l e a r s e l e c t i o n Does your paper address subitem 5-x?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study There is no human involvement in either the Vet Flexiquit or SmokefreeVET arms. Both programs are self-guided. subitem not at all important 1 2 3 4 5 essential 6a) Completely defined pre-specified primary and secondary outcome measures, including how and when they were assessed 5-xii) Describe any co-interventions (incl. training/support) Describe any co-interventions (incl. training/support): Clearly state any interventions that are provided in addition to the targeted eHealth intervention, as ehealth intervention may not be designed as stand-alone intervention. This includes training sessions and support [1]. It may be necessary to distinguish between the level of training required for the trial, and the level of training for a routine application outside of a RCT setting (discuss under item 21 -generalizability. Does your paper address subitem 5-xii? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study SMS text messages accompany both the Vet Flexiquit and the SmokefreeVET programs, as described in the interventions section of the methods. subitem not at all important 1 2 3 4 5 essential 6a-ii) Describe whether and how "use" (including intensity of use/dosage) was defined/measured/monitored Describe whether and how "use" (including intensity of use/dosage) was de ned/measured/monitored (logins, log le analysis, etc.). Use/adoption metrics are important process outcomes that should be reported in any ehealth trial.
Does your paper address subitem 6a-ii?

Copy and paste relevant sections from manuscript text
Use is defined primarily as number of log-ins and duration of use, as specified in the methods section.
subitem not at all important 1 2 3 4 5 essential 6b) Any changes to trial outcomes after the trial commenced, with reasons 6a-iii) Describe whether, how, and when qualitative feedback from participants was obtained Describe whether, how, and when qualitative feedback from participants was obtained (e.g., through emails, feedback forms, interviews, focus groups).

Does your paper address subitem 6a-iii?
Copy and paste relevant sections from manuscript text "Open-ended questions inquired about what participants liked the most and the least about their assigned program." Does your paper address CONSORT subitem 6b? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study No changes were made to the trial outcomes Does your paper address subitem 7a-i?
Copy and paste relevant sections from manuscript title (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study As a pilot treatment development project, this study was not designed for power to detect statistically significant differences by treatment group. However, we explored outcomes of the 2 interventions and obtained a preliminary estimate of effect size. We planned for a sample size of 50, which is consistent with the recommended sample size for pilot feasibility trials [46].

8a) Method used to generate the random allocation sequence
NPT: When applicable, how care providers were allocated to each trial group 8b) Type of randomisation; details of any restriction (such as blocking and block size) Does your paper address CONSORT subitem 7b? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study Not applicable; there were no interim analyses or stopping rules Does your paper address CONSORT subitem 8a? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study "Eligible participants were randomized using an automated algorithm via a custom webbased system at the baseline visit, which occurred approximately 1 week after screening and was conducted via telephone or a VA-approved conferencing program,. A permuted block design with random blocks of sizes 2 and 4 was used to balance randomization on the stratification variable: high (>5) or low (≤5 or less) readiness to quit on the Contemplation Ladder [39]." 9) Mechanism used to implement the random allocation sequence (such as sequentially numbered containers), describing any steps taken to conceal the sequence until interventions were assigned 10) Who generated the random allocation sequence, who enrolled participants, and who assigned participants to interventions Does your paper address CONSORT subitem 8b? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study "Eligible participants were randomized using an automated algorithm via a custom webbased system at the baseline visit, which occurred approximately 1 week after screening and was conducted via telephone or a VA-approved conferencing program,. A permuted block design with random blocks of sizes 2 and 4 was used to balance randomization on the stratification variable: high (>5) or low (≤5 or less) readiness to quit on the Contemplation Ladder [39]." Does your paper address CONSORT subitem 9? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study "Eligible participants were randomized using an automated algorithm via a custom webbased system at the baseline visit, which occurred approximately 1 week after screening and was conducted via telephone or a VA-approved conferencing program,. A permuted block design with random blocks of sizes 2 and 4 was used to balance randomization on the stratification variable: high (>5) or low (≤5 or less) readiness to quit on the Contemplation Ladder [39]. " 11a) If done, who was blinded after assignment to interventions (for example, participants, care providers, those assessing outcomes) and how NPT: Whether or not administering co-interventions were blinded to group assignment subitem not at all important 1 2 3 4 5 essential Does your paper address CONSORT subitem 10? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study Study staff enrolled participants. Randomization was automated. "Eligible participants were randomized using an automated algorithm via a custom web-based system at the baseline visit, which occurred approximately 1 week after screening and was conducted via telephone or a VA-approved conferencing program,. A permuted block design with random blocks of sizes 2 and 4 was used to balance randomization on the stratification variable: high (>5) or low (≤5 or less) readiness to quit on the Contemplation Ladder [39]." 11a-i) Specify who was blinded, and who wasn't Specify who was blinded, and who wasn't. Usually, in web-based trials it is not possible to blind the participants [1, 3] (this should be clearly acknowledged), but it may be possible to blind outcome assessors, those doing data analysis or those administering cointerventions (if any). Does your paper address subitem 11a-i? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study "Investigators and participants were blinded to both allocation sequence and intervention assignment." 11a-ii) Discuss e.g., whether participants knew which intervention was the "intervention of interest" and which one was the "comparator" Informed consent procedures (4a-ii) can create biases and certain expectations -discuss e.g., whether participants knew which intervention was the "intervention of interest" and which one was the "comparator".

Does your paper address subitem 11a-ii?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study Both interventions were labeled as Vet Flexiquit to blind participant to treatment group assignment.
11b) If relevant, description of the similarity of interventions (this item is usually not relevant for ehealth trials as it refers to similarity of a placebo or sham intervention to a active medication/intervention) 12a) Statistical methods used to compare groups for primary and secondary outcomes NPT: When applicable, details of whether and how the clustering by care providers or centers was addressed Does your paper address CONSORT subitem 11b? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study Not applicable for this trial Does your paper address CONSORT subitem 12a? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study A detailed statistical analysis plan is included at the end of the methods subitem not at all important 1 2 3 4 5 essential 12b) Methods for additional analyses, such as subgroup analyses and adjusted analyses 12a-i) Imputation techniques to deal with attrition / missing values Imputation techniques to deal with attrition / missing values: Not all participants will use the intervention/comparator as intended and attrition is typically high in ehealth trials. Specify how participants who did not use the application or dropped out from the trial were treated in the statistical analysis (a complete case analysis is strongly discouraged, and simple imputation techniques such as LOCF may also be problematic [4]).
Does your paper address subitem 12a-i? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study "Consistent with the Russell standard for smoking cessation trials, participants with missing smoking data were considered nonabstinent [48] in the primary analysis of cessation outcomes. As a sensitivity analysis, we also reported the results of complete-case analyses. Treatment acceptability and process measures (i.e.e, AIS scores) were analyzed using complete-case case analysis, as there was no reasonable method of imputing these data."

X26) REB/IRB Approval and Ethical Considerations [recommended as subheading under "Methods"] (not a CONSORT item)
subitem not at all important 1 2 3 4 5 essential Does your paper address CONSORT subitem 12b? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study Not applicable in this pilot trial

X26-i) Comment on ethics committee approval
Does your paper address subitem X26-i?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study Ethical considerations, including IRB approval, are listed in the methods section.

x26-ii) Outline informed consent procedures
Outline informed consent procedures e.g., if consent was obtained o ine or online (how? Checkbox, etc.?), and what information was provided (see 4a-ii). See [6] for some items to be included in informed consent documents.

Does your paper address subitem X26-ii?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study At the beginning of the first telephone visit, participants were provided with detailed information about the study, and verbal consent was obtained following the guidelines of the VA Bedford Healthcare System Institutional Review Board. Following informed consent, participants completed the study procedures as outlined in the research plan. Veterans who were screened as ineligible to participate were provided with information about other resources to help them quit smoking.

X26-iii) Safety and security procedures
Safety and security procedures, incl. privacy considerations, and any steps taken to reduce the likelihood or detection of harm (e.g., education and training, availability of a hotline)

Does your paper address subitem X26-iii?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study To protect participants' confidentiality, identifiable information collected as part of the study screening and enrollment procedures was stored in a VA shared drive that was not accessible to anyone outside of the research team, and each participant was assigned a code that linked all of their data. Once participants were enrolled in the trial, a limited set of identifiers that were needed for the intervention to be implemented (ie, first name, email address, mobile telephone number, number of cigarettes smoked per day, and cost per pack of cigarettes) were entered into the secure study portal, which had a security feature that prohibited the subsequent retrieval of this information.
13a) For each group, the numbers of participants who were randomly assigned, received intended treatment, and were analysed for the primary outcome NPT: The number of care providers or centers performing the intervention in each group and the number of patients treated by each care provider in each center 13b) For each group, losses and exclusions after randomisation, together with reasons Does your paper address CONSORT subitem 13a? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study The sample size for each of the analyses is specified in the results.
Does your paper address CONSORT subitem 13b? (NOTE: Preferably, this is shown in a CONSORT flow diagram) * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study The participant flow (CONSORT) diagram includes this information. Strongly recommended: An attrition diagram (e.g., proportion of participants still logging in or using the intervention/comparator in each group plotted over time, similar to a survival curve) or other gures or tables demonstrating usage/dose/engagement.

Does your paper address subitem 13b-i?
Copy and paste relevant sections from the manuscript or cite the gure number if applicable (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study This is not included in the manuscript Does your paper address CONSORT subitem 14a? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study The final sample comprised 49 participants who were randomized between February 3, 2021 and October 22, 2021.
14a-i) Indicate if critical "secular events" fell into the study period Indicate if critical "secular events" fell into the study period, e.g., signi cant changes in Internet resources available or "changes in computer hardware or Internet delivery resources" Does your paper address subitem 14a-i?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study As noted in other responses, COVID-19 impacted the study design, which is noted in the manuscript 14b) Why the trial ended or was stopped (early) 15) A Does your paper address CONSORT subitem 14b? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study Not applicable, trial was not stopped early Does your paper address CONSORT subitem 15? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study Does your paper address subitem 15-i? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study The focus of this work was socioeconomically disadvantaged veterans, and measures of socioeconomic disadvantage are included (e.g, homelessness, having trouble paying bills).
subitem not at all important 1 2 3 4 5 essential 16-i) Report multiple "denominators" and provide definitions Report multiple "denominators" and provide de nitions: Report N's (and effect sizes) "across a range of study participation [and use] thresholds" [1], e.g., N exposed, N consented, N used more than x times, N used more than y weeks, N participants "used" the intervention/comparator at speci c pre-de ned time points of interest (in absolute and relative numbers per group). Always clearly de ne "use" of the intervention.
Does your paper address subitem 16-i? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study Denominators are included for all analyses 17a) For each primary and secondary outcome, results for each group, and the estimated effect size and its precision (such as 95% confidence interval)

16-ii) Primary analysis should be intent-to-treat
Primary analysis should be intent-to-treat, secondary analyses could include comparing only "users", with the appropriate caveats that this is no longer a randomized sample (see 18-i).

Does your paper address subitem 16-ii?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study Primary analysis is acceptability, which is measured via satisfaction and utilization. Utilization outcomes are intent to treat, but satisfaction is complete case since it is only available for those who completed an outcome survey measuring satisfaction. Does your paper address CONSORT subitem 17a? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study This information is provided in Table 2.
17a-i) Presentation of process outcomes such as metrics of use and intensity of use In addition to primary/secondary (clinical) outcomes, the presentation of process outcomes such as metrics of use and intensity of use (dose, exposure) and their operational de nitions is critical. This does not only refer to metrics of attrition (13-b) (often a binary variable), but also to more continuous exposure metrics such as "average session length". These must be accompanied by a technical description how a metric like a "session" is de ned (e.g., timeout after idle time) [1] (report under item 6a).
17b) For binary outcomes, presentation of both absolute and relative effect sizes is recommended 18) Results of any other analyses performed, including subgroup analyses and adjusted analyses, distinguishing pre-specified from exploratory Does your paper address subitem 17a-i?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study Metrics of use are part of the primary acceptability outcomes Does your paper address CONSORT subitem 17b? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study Quit rates and odds ratios are presented for smoking cessation outcomes Does your paper address CONSORT subitem 18? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study Not applicable for this pilot trial

18-i) Subgroup analysis of comparing only users
A subgroup analysis of comparing only users is not uncommon in ehealth trials, but if done, it must be stressed that this is a self-selected sample and no longer an unbiased sample from a randomized trial (see 16-iii).

Does your paper address subitem 18-i?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study Not applicable for this pilot trial Does your paper address CONSORT subitem 19? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study There were no intervention-related harms or unintended effects.

19-i) Include privacy breaches, technical problems
Include privacy breaches, technical problems. This does not only include physical "harm" to participants, but also incidents such as perceived or real privacy breaches [1], technical problems, and other unexpected/unintended incidents. "Unintended effects" also includes unintended positive effects [2].

Does your paper address subitem 19-i?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study There were no privacy breaches or major technical problems. subitem not at all important 1 2 3 4 5 essential 22-i) Restate study questions and summarize the answers suggested by the data, starting with primary outcomes and process outcomes (use) Restate study questions and summarize the answers suggested by the data, starting with primary outcomes and process outcomes (use).
Does your paper address subitem 22-i? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study The discussion starts with a restatement of the aims and a summary of key findings.

Does your paper address subitem 22-ii?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study The conclusions

20-i) Typical limitations in ehealth trials
Typical limitations in ehealth trials: Participants in ehealth trials are rarely blinded. Ehealth trials often look at a multiplicity of outcomes, increasing risk for a Type I error. Discuss biases due to non-use of the intervention/usability issues, biases through informed consent procedures, unexpected events.
Does your paper address subitem 20-i? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study

21-i) Generalizability to other populations
Generalizability to other populations: In particular, discuss generalizability to a general Internet population, outside of a RCT setting, and general patient population, including applicability of the study results for other organizations Does your paper address subitem 21-i?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study Generalizability is limited to the population of socioeconomically disadvantaged veterans served through VHA Discuss if there were elements in the RCT that would be different in a routine application setting (e.g., prompts/reminders, more human involvement, training sessions or other cointerventions) and what impact the omission of these elements could have on use, adoption, or outcomes if the intervention is applied outside of a RCT setting.
Does your paper address subitem 21-ii?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study This is not discussed in the paper Does your paper address CONSORT subitem 23? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study Clinicaltrials.gov registration number is listed in the paper Does your paper address CONSORT subitem 24? * Cite a Multimedia Appendix, other reference, or copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study The full trial protocol is available from the first author, by request. This is not explicitly noted in the paper.
Does your paper address CONSORT subitem 25? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study "This work was funded by a grant from the US National Cancer Institute, R21CA236980, to JLH and MMK." About the CONSORT EHEALTH checklist X27-i) State the relation of the study team towards the system being evaluated In addition to the usual declaration of interests ( nancial or otherwise), also state the relation of the study team towards the system being evaluated, i.e., state if the authors/evaluators are distinct from or identical with the developers/sponsors of the intervention.
Does your paper address subitem X27-i?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study The authors have no financial conflicts related to the system being evaluated. Information regarding conflicts of interest is presented in the manuscript.
yes, major changes yes, minor changes no yes no Other: As a result of using this checklist, did you make changes in your manuscript? * What were the most important changes you made as a result of using this checklist?
Remembering to acknowledge our funding from NCI How much time did you spend on going through the checklist INCLUDING making changes in your manuscript * Probably 4 hours. Way, way too long. This form is unnecessarily burdensome and makes me not want to submit to JMIR again. Also, with such a lengthy form, there really needs to be an option to save responses and come back.
As a result of using this checklist, do you think your manuscript has improved? * STOP -Save this form as PDF before you click submit To generate a record that you lled in this form, we recommend to generate a PDF of this page (on a Mac, simply select "print" and then select "print as PDF") before you submit it.
When you submit your (revised) paper to JMIR, please upload the PDF as supplementary le.
Don't worry if some text in the textboxes is cut off, as we still have the complete information in our database. Thank you!